Multiple Description Vector Quantization with Lattice 
Codebooks: Design and Analysis 



Vinay A. Vaishampayan, N. J. A. Sloane 
AT&T Shannon Laboratory 
Florham Park, NJ 07932 

and 

Sergio D. Servetto 

Ecole Polytechnique Federale de Lausanne, CH-1015 Lausanne, Switzerland 
Jan. 25, 2000; revised Oct. 7, 2000 

Abstract 

The problem of designing a multiple description vector quantizer with lattice codebook A 
is considered. A general solution is given to a labeling problem which plays a crucial role 
in the design of such quantizers. Numerical performance results are obtained for quantizers 
based on the lattices A 2 and Z 4 , i = 1, 2, 4, 8, that make use of this labeling algorithm. 

The high-rate squared-error distortions for this family of L-dimensional vector quantizers 
are then analyzed for a memoryless source with probability density function p and differential 
entropy h(p) < oo. For any a G (0, 1) and rate pair (R, R), it is shown that the two-channel 
distortion do and the channel 1 (or channel 2) distortion d s satisfy 

lim d 2 2R ^ = -G(A)2 2h ^ 

R^oo 4 

and 



R 



lim d s 2 2R{1 ~ a) = G{S L )2 2h{ - p \ 



where G(A) is the normalized second moment of a Voronoi cell of the lattice A and G(Sl) 
is the normalized second moment of a sphere in L dimensions. 



Index Terms: Source Coding, Quantization, Multiple Descriptions, Lattice Quantization, 
Vector Quantization, Hexagonal Lattice, Cubic Lattice. 
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1 Introduction 

We consider the problem of designing a multiple description vector quantizer for a mem- 
oryless source with probability density function p, differential entropy h(p) < oo and the 
squared-error distortion measure. A multiple description vector quantizer encodes vectors 
for transmission over a two-channel communication system. The objective is to send infor- 
mation about the source vector over each channel in such a way that good performance is 
obtained when both channels work and the degradation is small when either channel fails. 
It is assumed that the encoder has no knowledge about the state of a channel, i.e., it does 
not know whether a channel has failed or is working. 

The recent interest in the multiple description problem is largely because of the applica- 
tion to image, video and voice communications over packet networks with nonzero probability 
of packet loss. The loss of a packet could be significant if it results in a loss of a large block of 
source samples, such as a large image block or a large block of speech. One way to improve 
performance is to place different encoded versions of a given block of source samples into 
several packets in such a way that if some of these packets are received, a degraded version of 
the source block may be recovered. This leads to the formulation of the multiple description 
source coding problem. 

For the single-description problem, one of the benefits of vector quantization over scalar 
quantization is a reduction in granular distortion. This is because in higher dimensions it 
is possible to construct Voronoi cells that are more "spherical" than the hypercube. To be 
more specific, uniform scalar quantization coupled with entropy coding is known to have 



mean squared error (mse) d(R) at entropy R bits/sample satisfying |L6 

2 2/i(p) 



2R 



lim d(R)2 

R— >oo IZ 
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whereas if an L-dimensional lattice A is used as a codebook, the distortion satisfies 

lim d(R)2 2R = G(A)2 2h( - p \ (2) 



R—+OC 



where G(A) is the normalized second moment of a Voronoi cell of the lattice. In dimensions 
greater than one, lattices exist for which G(A) is strictly smaller than 1/12. For example, in 
8 dimensions, it is possible to gain 0.66 dB by using the lattice E 8 as compared to uniform 
scalar quantization |TTj. It is also known through a random quantizing argument |3I] that 



quantizers exist for which the product d(R)2 2R approaches 2 2h ^ / (27ie) as the rate increases. 
Furthermore, it follows from rate distortion theory || that no smaller value can be achieved 
for the above product in the limit of infinite rate. The maximum gain possible over entropy- 
coded scalar quantization is 1.53 dB and lattices provide a useful method for closing this 
gap. 

From now on we will restrict our attention to the case of two channels. Consider a 
multiple description quantizer which sends information across each channel at a rate of R 
bits/sample. The performance of this system is measured in terms of three distortions: the 
two-channel distortion do, when both descriptions are available to the decoder; the channel 
1 distortion d±, when only the first description is available and the channel 2 distortion g?2, 
when only the second description is available. We will further assume that d\ = d<i = d s 
and will refer to this common value as the side distortion. The objective is to design vector 
quantizers that minimize do under the constraint d s < D s , for a given rate pair (R,R) and 
a given bound D s on the side-channel distortion. 



It has been shown | J that for a uniform entropy-coded multiple description quantizer, 



and any a 6 (0, 1), the distortions satisfy 



1 /2 2h (p)\ 



) 
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On the other hand, by using a random quantizer argument it was shown J | that by encoding 
vectors of infinite block length, it is possible to achieve distortions 

lim d (R)2 2R ^ = U — , 
R^oc uv ; 4 V 27re J ' 

, s /2 2 Mp)\ 

lim 4( J R)2 2R ( 1 ~ a ) = . (4) 

R^oo y 27re / 

Thus by using multiple description quantization it is possible to simultaneously reduce the 
two-channel and side-channel granular distortions by 1.53 dB. 

In single description quantization, an extra transmitted bit reduces the squared error 
distortion by a factor of 4 (this is seen in ([I])). However, in multiple description quantization 
there is additional flexibility. If each R is increased by 1/2 bit, the two-channel distortion 
can be decreased by 2~( 1+a * > and the side distortion by 2~ ( - 1 ~ a \ for any a E (0, 1). This means 
that by using an extra bit, the distortions do and d s can be made to decrease by different 
amounts as long as the product decreases by a factor of 4. 

The goal of this paper is to give constructions for closing this "1.53 dB" gap and to analyze 
the resulting performance gains. Our approach is as follows. From classical quantization 
theory, we know that the gap between scalar quantization and the rate distortion bound 
may be closed by using vector quantizers with lattice codebooks. Certainly, by following this 
approach we can also close the gap between the two-channel distortion and the rate-distortion 
bound. In particular, this will allow us to replace the factor (1/12) in the expression for do 
in (|3p with G(A), the normalized second moment of the Voronoi region of a lattice point. 
The main question we address here is that of simultaneously reducing d s . How can such a 
reduction be achieved and what is the quantity that will replace the factor (1/12) in the 
expression for d s in @? We will show through a constructive procedure that the distortion 
d s can be reduced by solving a specific labeling problem. To our surprise, the quantity that 
replaces (1/12) is G(Sl), the normalized second moment of a sphere in L dimensions. 

Let do{R,L) and d s (R,L) denote the two-channel and single channel distortions at rate 
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Figure 1: Limiting two-channel and single-channel distortion ratios liniR^oo do(R, L)/do(R, 1) and 
lim^^oo d s (R, L)/di(R, 1) as a function of the lattice dimension L. The reduction in two-channel 
distortion is lattice dependent and is determined by the normalized second moment of a Voronoi 
region of the lattice. The reduction in single-channel distortion depends only on the dimension of 
the lattice. 

R for an L-dimensional quantizer. Fig. |l] summarizes the main results of the paper. In 
this figure we have plotted the limit of the normalized two-channel and single-channel dis- 
tortions, ImiR^oo do(R, L)/do(R, 1) and lim^oo d s (R, L)/d s (R, 1) respectively, for lattices of 
various dimensions. It is seen that the limit for the two-channel distortion is given by the 
ratio G(A)/G(Z), which depends on the lattice, whereas for the side distortion the limit is 
G(Sl)/G(Si), which is independent of the lattice. 

2 Previous Work 



An achievable rate region for the multiple description problem was first given in |TJ| and 
it was shown in |24| that this region coincides with the rate distortion region for a mem- 



2 PREVIOUS WORK 



6 



oryless Gaussian source with a squared-error distortion measure. The problem of multiple 
description quantizer design, including a formulation and solution of the underlying labeling 
problem in one dimension, was presented in An asymptotic performance analysis of 

this quantizer was presented in ||]. A preliminary version of the work presented here was 
first presented in (2^ . 

Lattice quantizers (for the single description problem) have been extensively studied. 
In |3l| a random quantization argument is used to give upper and lower bounds on the 
performance of quantizers for a fixed dimension. Detailed descriptions of the Voronoi regions 
of specific lattices are given in |J and their second moments are evaluated. Fast quantizing 
algorithms for lattice quantizers are given in flOfl , [|]], [0], [ 30 1 . In [[Tj| it is conjectured that 
for rth power difference distortion measures, any optimal quantizer, in any dimension, has 
Voronoi regions that are congruent to some polytope. 

Approaches to multiple description coding based on trellis coded quantization are pre- 
sented in [f28], p0| , those based on vector quantization are presented in |13|] and approaches 
using forward error correction are presented in . 

There are also approaches to multiple description coding based on subspace methods. 
One approach is to design a predictor or a transform so as to achieve a correlation structure 
that allows one half of the prediction error samples or transform coefficients to be predicted 



from the other half. Examples of this approach are presented in [|19], £3|, [2£ 

Another approach to multiple description coding is based on using overcomplete expan- 
sions. Here the idea is to construct a redundant signal representation, in a way that allows 
the signal to be estimated with a controlled amount of error when the representation is 
incompletely received [|3[ f7| |17|. 



3 ORGANIZATION OF THE PAPER 



7 



3 Organization of the Paper 

The multiple description vector quantizer is described, notation is established, certain reg- 
ularity assumptions for the labeling function are stated and preliminary expressions are 
derived for rates and distortions in Section f|. A detailed example with the two-dimensional 
hexagonal lattice A2 is presented along with some general theory in Section |[ The necessary 
theory for general lattices is presented in Section ||]. An asymptotic analysis for a fixed vector 
dimension is presented in Section [7[ The paper is summarized along with conclusions and 
directions for future work in Section || 

4 Preliminaries 



A block diagram of a multiple description vector quantizer (MDVQ) with a lattice codebook 
is shown in Fig. [| 



Ai 



Source 




Q 




a 


X 


A 









An 



Channel 1 



Channel 2 



Decoder 



a* 




A ' 



Decoder 



Decoder 



AT 



Figure 2: Block diagram for a multiple description vector quantizer. 

A source of information generates a sequence of independent, identically distributed 
random variables with probability density function (pdf) p. This source is blocked off into 
L- dimensional vectors x = (x\, £2, • • • , The L-fold pdf is denoted by pl, where pl(x) = 
[\i=iP( x i)- The vector x is quantized to the nearest vector A in a lattice A C R i . We denote 
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the quantizer mapping by A = Q(x). Information about the selected code vector A is then 
sent across the two channels, subject to rate constraints imposed by the individual channels. 
This is done through a labeling function a followed by entropy coding. The labeling function 
a maps A G A to a pair (A^, A' 2 ) G A' x A', where A' is a sublattice of A with index N. The 
component functions of a are denoted by a.\ and a 2 , where ai(A) = X[ and 02(A) = A' 2 . 
For simplicity we assume that A' is geometrically similar to A, i.e., A' can be obtained by 
scaling, rotating and possibly reflecting A. Note that points in the lattice A are denoted by 
A, possibly with subscripts, whereas sublattice points will be denoted by A' or A", possibly 
with subscripts. 

In Fig. |3], a portion of the hexagonal lattice A 2 is illustrated, along with a geometrically 
similar sublattice of index 31. The lattice points lie at the intersection of the straight lines 
in the hexagonal grid (only some of the points are shown). The sublattice points are marked 
with upper-case letters. Observe that the lattice is 31 times as dense as the sublattice, i.e., 
there are 31 lattice points for every sublattice point. 

At the decoder, if only channel 1 works, the received information is used to decode A' 1; 
and if only channel 2 works, the information received over channel 2 is used to decode A' 2 . 
The mapping a is assumed to be one-to-one so that if both channels work A can be recovered 
from (X[, A' 2 ). (In practice, if only one channel is working it may be better to decode the 
received vector to some function of X[ or A 2 rather than to A' : or A' 2 itself. If X[ is received 
but A' 2 is not, for instance, we would decode A' : as the center of mass of all points A G A such 
that the first component of a (A) is X[. We will ignore this complication in order to simplify 
the analysis.) 

Given A, A' and a, there are three distortions and two rates associated with an MDVQ. 
For a given x mapped to the triple (A, A' l7 A 2 ) by the MDVQ, the two-channel distortion do is 
given by \\x — A|| 2 , the channel 1 distortion d\ by — A'JI 2 and the channel 2 distortion <i 2 by 
\\x — X' 2 \\ 2 (we assume that the inner product of L-dimensional vectors x = (xi,x 2 , . . . ,xl) 
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and y = (yi, V2, ■ ■ ■ ,Vl) is given by (x,y) — (1/L) $2i=i x iVi an d the corresponding norm 
is = (x, x) 1//2 , i.e., the inner product and norm are dimension- normalized) . The corre- 
sponding average distortions are denoted by do, d\ and o^- We assume that an entropy coder 
is used in order to transmit the labeled vectors at a rate arbitrarily close to the entropy, i.e., 
Ri = W(ct!j((5(X))) / L, i — 1, 2, where 7i(U), the entropy of the random variable [/ taking val- 
ues in alphabet IA with probability distribution P is given by 7i(U) = — J2 u &j P( u ) ^°gP(. u )- 

The problem is to design the labeling function a so as to minimize do subject to d\ < D s , 
d-i < D s , and Ri < R, i = 1,2, for specified values of the rate i? and distortion D s . 

The Voronoi (or nearest neighbor) region V(A) of a point A G A is defined to be 

V(X)= f {x : Us -A|| < Us -A||, VAe A}. (5) 

With each sublattice point A' G A', we associate a discrete Voronoi set (with N elements) 

V (X') = f {XeA : || A - A'|| < || A — A"||, VA" G A'}. (6) 

In (^|) and (ffl) ties (i.e., points for which equality holds in the defining condition) are broken 
in some prearranged manner. The existence of sublattices for which no ties occur is discussed 
in [||. The Voronoi region V(0) and the discrete Voronoi region Vo(0) are both illustrated in 
Fig. |. 

We regard the label for A as a directed edge e = (ai(A), 02(A)) of the graph with 
vertex set A'. The corresponding unordered pair e = {ati(\), 02(A)} will be referred to as 
the undirected edge or undirected label associated with A. The essential difference between 
a directed edge or label (A' a , X' b ) and the undirected edge {A^, X' b } is that for the directed 
edge there is an implicit association between edge component and channel (A' a is sent on 
channel 1 and X' b is sent on channel 2) whereas for the undirected edge no association is 
implied. Graphically, an edge connecting two sublattice points X' a and X' b , with an arrow 
pointing from A^ to X' b , indicates that A^ is sent on channel 1 and A£, is sent on channel 2, or 
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Figure 3: This figure show a portion of the A 2 lattice (the points on the grid line intersec- 
tions), part of a geometrically similar sublattice of index 31, a discrete Voronoi set for a 
sublattice point (the lattice points in the hexagon) and the Voronoi set of a sublattice point 
(all the points in the hexagon). 

equivalently, the directed edge is (A^, X' b ). The two directed versions of an (undirected) edge 
e will be denoted e and e . 

For a given labeling function a, an associated undirected edge labeling function a u is 
defined as follows: if ct(A) = e , then a u (X) = e, i.e., a u maps A to its undirected label. 
Note that if a(X±) = e and a(X2) = 4 e~, then a u (Xi) = a u (X2) = e, i.e., a u is not one-to-one. 
A directed edge is uniquely associated with a lattice point whereas an undirected edge will 
in general be associated with two lattice points, one for each orientation of the edge. The 
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Figure 4: Various edge sets are illustrated for a sublattice of A 2 with N = 31. For clarity 
only the sublattice points are shown. The set £ u \ ai =o is shown on the left, Sa\ ai =o on the 
right. The origin is located at the center of the circle. 

Certain sets associated with the two maps will play a central role in the development. 
The first is £<f(A') = a(Vb(A')), the set of all labels for points in Vb(A') (the subscript d 
indicates that the edges are directed). The corresponding set of undirected edges is denoted 
by £ u {\'). More specifically, £ u (\') = a u (Vo(A')). The set of all (directed) labels is denoted 
by £d = Ua'sA' £d(A') and the set of all undirected labels by £ u = Ua'gA' ^w(A')- ft is also 
useful to define the restriction £d\ ai =o = {(A'^A^) G ^d, A' x = 0}. The set of undirected 
edges in £d\ ai =o will be denoted by £ u \ ai =o- The sets £ u \ ai =o and £d\ ai =o are illustrated in 
Fig. | 

The reitse index associated with a label A' and channel % is defined to be A^(A') = 
| {A : «i(A) = A'} |, the number of lattice points A for which a»(A) = A'. 

In order to render the problem tractable, we assume that the labeling function has the 
following properties. 

• Property 1: The reuse index iVj(A') = N, for all A' G A' and i = 1,2. In other words 
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each channel i label is reused exactly N times. 

• Property 2: The shift property: a u (X + A') = a u (X) + A', for all A G A and A' G A'. 

• Property 3: Each undirected edge e = {A^A^}, A' : ^ A' 2 , labels two points, A a and 
Ab, and A a + X b = X[ + A' 2 . 

The first assumption makes it easy to parametrize the tradeoff between the side and cen- 
tral distortions. The second assumption reduces the labeling problem to one of labeling a 
finite set. The third assumption is a simple way to achieve exact balance between the two 
descriptions (its implications will become clearer in Section |5.2.3|) . 

It will prove useful to have the following definitions of equivalence. 
Definition 1: Two lattice points Ai and A2 are said to be equivalent if either Ai and A2 or 
Ai and — A2 lie in the same coset of A relative to the sublattice A'. 

Definition 2: Two sublattice edges e± and e 2 are said to be equivalent if they are parallel 
and of equal length, or equivalently if e± + X' — e 2 for some A' G A'. 

The equivalence class of an object will be indicated by square brackets. Thus [A] is the 
equivalence class of A and [e] is the equivalence class of e, or equivalently, [A] G A/A' and 



Since the codebook of the quantizer is a lattice, all the Voronoi regions are congruent. 
Furthermore, upon assuming that each Voronoi region is small so that Pl{x) ~ Pl{X) for 
x G ^(A) and upon letting v denote the L-dimensional volume of a Voronoi region, we obtain 



[e] G £ U /A'. 



4.1 Distortion Computation 



The average two-channel distortion do is given by 




(7) 
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the following expression for the two-channel distortion [ '. 

d * Iv{0) ^f dX , (8) 
which in terms of the normalized second moment G(A), defined by 

is given by 

d « G(K)v 2/L . (10) 

— — — def — — 

We now derive expressions for the average distortions d\ and c?2 and d s = (d\ + d^jl. 
When only description 1 is available, the distortion is given by 



di = y~] I ||a:-ai(A)|| 2 pi(a;)da; 

= 2_. \ \\x — X + X — ai(X)\\ 2 pL(x)dx 

= J2 f X\\ 2 PL {x)dx + Y] [ ||A-a 1 (A)||V(^)^+ (11) 

AgA M*) AgA M*) 

2 > / (x — A, A — cci(A)) pL(x)dx 

AGA J VW 

= d + V||A- ai (A)|| 2 P(A) + 2 W / xp L (x)dx- [ 

AGA AGA \M» JV 



V(X) JV(X) 

rfo + ^||A-ai(A)|| 2 P(A), (12) 



(a) 

= «o-t- 

aga 

where P (A) = Pr(Q(X) = A), and (a) follows by assuming that A is the centroid of its 
Voronoi region. This is true for the uniform density. For nonuniform densities, there is an 
error term which goes to zero with the size of the Voronoi region. The first term in ( |12[) 
is the two-channel distortion and the second term is the excess distortion which is incurred 
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when channel 2 fails. Note that for a given A, only the excess distortion term is affected by 
the labeling function a. From (|T2"D, it follows that 

d. = do+(l/2)^(||A- ai (A)|| 2 + ||A-a 2 (A)|| 2 )P(A) (13) 
AeA 

= d +(l/2)J2 E (l|A-«i(A)|| 2 + ||A-a 2 (A)|| 2 )P(A). (14) 

A'eA' AGVb(A') 

We also introduce the following notation: d 1 (X, e ) = ||A — A^|| 2 and d^X, e ) = ||A — A 2 || 2 
and d s (\, e) = (di( e) + o?2(~e*))/2, where e = (A' l7 A 2 ). Note that c? s (A, e ) = <i s (A, 4 e"). 
Hence when appropriate, we will write d s (X,e). Also, when the edge associated with the 
lattice point is clear from the context, we will write d s (X) or d s ( e ) instead of d s (X, e). It 
is useful (as a design guide and for the asymptotics which follow) to write down a slightly 
different expression for the side distortion where the sum is taken over the edge set £^ = 
Ua'gA' £d(A'): 

ds = do+ E d s{~e)P{~e) 
A'eA' -?e£ d (\') 

where P{~e) is equal to the probability of the lattice point that the edge labels, i.e., P(~e) = 
Pr(Q(X) = A). 

4.2 Rate Computation 

Expressions for the rate (in bits/sample) will be derived next. Let R be the rate required 
to address the two-channel codebook for a single channel systemQ We will first derive an 
expression for Rq and then determine the (per-channel) rate R of the multiple description 
system. 

J This quantity is useful for evaluating the two-channel distortion as well as for evaluating the rate overhead 
associated with the multiple description scheme. 
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In order to derive expressions for Rq and i?, we use the fact that each quantizer bin has 
identical volume v and that Pl(x) is approximately constant over Voronoi regions of the 
sublattice ^(A'). The second assumption is valid in the limit as the Voronoi regions become 
small and is standard in asymptotic quantization theory. 

The rate R Q = H{Q{X)) is given by f0 



Rn 



(1/L)W MM J M 

X J V(X) JV(X) 

(V-^OE / PL(x)dxlog 2 p L (X)u 

, JV(X) 



h{p) - (l/L)log 2 (v). 



(16) 



For R, we evaluate the entropy 7i{ai{Q{X))) and then use the approximation that Pl{x) 
is roughly constant over each Voronoi region of A' to get 



R 



w EE/ Mx)dx i io g2 

A'eA' \xea~ 1 (\') Jv(x) 



E 



Pl(x)cIx 



l\xe«-\x>) JvW 



w EE/ p^ dx I lo §2 faMNu) 

A'eA' Xxea-^y) V{X) 



-(V£) E ( E / 

VGA' VAGa-^A') V(A) 

%)-(l/L)log 2 (iVz/). 



p L (a;)log 2 (p L (A'))cfe - (1/L) log 2 (M/) 



;i7) 



Observe that in the above equation, the term Nv is simply the volume of a fundamental 
region for the sublattice A' (since it has index N in A). Upon writing (|T7|) in terms of Rq 
we obtain 



i* = i2o-(l/L)log 2 (jV). 



(1* 



A single channel system would have used Rq bits/sample to achieve the same do- Instead a 
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multiple description system uses a total of 2R = 2R — (2/L) \og 2 (N) bits/sample, and so 
the rate overhead is i? — (2/L) log 2 (iV). 

5 A Labeling Function for A<i 

We now look for a labeling function a for which Yl~?E£ d (\') ^«( e ) ^ s minimized and is inde- 
pendent of A'. Since the details are complicated, we will work out the first example-for the 
hexagonal lattice A 2 -quite carefully. We will then identify certain general principles and 
use them to construct labelings for other lattices. 

The lattice A 2 may be considered to be a subset of 1R 2 or as a subset of (D. Since each 
approach has its advantages, we will switch back and forth between the two representations. 
We consider the lattice A 2 at unit scale to be generated by the vectors C (D, where 

uj = — 1/2 + i\/?>/2. The associated Gram matrix is ^ —1/2 J anc ^ the fundamental 
volume is y/3/2. A sublattice A' of a lattice A is said to be geometrically similar to A if 



it can be obtained by scaling and rotating and/or reflecting A [ I|. To be more precise, if 
a matrix G' generates A' and G generates A, then A' is geometrically similar to A if and 
only if G' = cl/GB, for some nonzero scalar c, integer matrix U with determinant ±1, 
and real orthogonal matrix B. The index N is defined as the ratio of the fundamental 
volumes of A' and A and is given in terms of the scale factor c by N = c 2 . It can be 
shown H that A' is similar to A if and only if N is of the form a 2 — ab + b 2 , a,b £ Z; 
if this holds then A' is generated by u = a + bio and v = to(a + ho). In addition to this 
restriction on N, we will require, for convenience only, that = *Ylf =0 A±, where A4 is the 
number of lattice points at squared distance % from the origin. In other words, we require 
that A^ is the number of points in the first K shells of the lattice, for some K = K(N). 
There are heuristic arguments, to be presented elsewhere, which suggest that there are 
infinitely many values of A^ with this property. For example, A^ = 31 has this property, since 
N = + + A 3 +A 4 = 1 + 6 + 6 + 6 + 12 = 31, and 31 is also of the form a 2 -ab + b 2 , 
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with a = 5, b = — 1. 
5.1 An Example 

H • 




K 

Figure 5: Example to illustrate the mechanics of the labeling for the hexagonal lattice A 2 . 

We now present an example of a labeling function with a reuse index N = 31. The 
following are the steps in constructing the labeling function. 



1. Find a sublattice with index equal to the reuse index. 
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2. Determine the discrete Voronoi set Vo(0). 

3. Determine an undirected label for every point A G Vo(0). 

4. Extend the labeling to the entire lattice using the shift property of the undirected 
labels. 

5. Given A and its undirected label e, determine the correct directed label ~~e (i.e., deter- 
mine which endpoint of e is to be sent on channel 1 and which endpoint on channel 
2). 

A sub lattice A' of index equal to 31 may be obtained by considering all points of the form 
au + bv, with u = 5 — uo and v = u(5 — to). A portion of this lattice together with some 
sublattice points is shown in Fig. ^. Lattice points have been labeled with lower-case letters 
a, b, c, . . . and sublattice points with upper-case letters O, A, B, C, . . . . In order to fix the 
coordinate system, note that the sublattice point O is the origin of the complex plane and 
the lattice points a and c have representations 1 and uo respectively. Relative to this basis, 
the representations of sublattice points A and C are 5 — u and u(5 — lu), respectively. The 
discrete Voronoi set Vb(0) = {O, a,b,c, . . . ,y, z, aa, ab, ac, ad} is also shown in Fig. ^[ Note 
that | Vo (0) | = 31. Points in Vo(0) will be labeled using directed edges obtained from the 
following set of 28 undirected edges: 

S u (0) = {{0,0}, (19) 
{O, A}, {O, B}, {O, C}, {O, D}, {O, E}, {O, F}, 
{A, C}, {B, D}, {C, E}, {D, F}, {E, A}, {F, B}, 
{A,D},{B,E},{C,F}, 

{G, D}, {G, E}, {H, E}, {H, F}, {I, F}, {I, A}, 

{J, B}, {J, A}, {K, C}, {K, B}, {L, C}, {L, D}}, (20) 
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which are illustrated in Fig. Three edges in this set, namely {A, D}, {B, E} and {C, F}, 
will be used twice (i.e., both orientations will be used) in order to obtain 31 labels. 
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Figure 6: The set of undirected edges S u (0) for the example in Section p7f\ . For clarity only 
a subset of S u (0) is shown. The entire set may be obtained by rotating each edge around the 
origin (sublattice point O) by multiples of tt/3 radians. S u (0) consists of 28 distinct edges 
obtained by counting six edges for each edge in the figure, except for the diameter, for which 
only three edges are counted. The edge {O, 0} is not shown. 
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Table 1: Labels for points in the discrete Voronoi set Vo(0). The first step is to assign 
an undirected label to each lattice point in Vo(0). In this case the labeling was done by 
hand, though an optimal procedure is described in Section |5.2.2[ It is important that if two 
lattice points sum to zero, the midpoints of their labels also sum to zero (equivalent points 
are shown in the same row). The second step is to assign a color c(e) (0 or 1) to each edge 
and then to use this to determine the orientation of each edge. If c(e) = 0, the endpoint of 
e which is closer to A becomes the channel 1 label and the endpoint which is farther from 
A becomes the channel 2 label. On the other hand if c(e) = 1, the endpoint of e which is 
closer becomes the channel 2 label and that which is farther becomes the channel 1 label. 
The labeling is extended to the entire lattice using the shift property of a u . 



5 A LABELING FUNCTION FOR A 2 



22 



Each point in Vo(0) is then associated with an undirected edge in S u (0) as shown in 
Table [I]. This association was done by hand (but see Section 4.2.2). The only constraint is 
that equivalent points are mapped to equivalent edges-this can be clearly seen in the table, 
where equivalent lattice points have been placed in the same row. In order to complete the 
labeling we need to assign a directed edge to each lattice point based on the color c(e) (0 or 
1 valued) associated with that edge. This is illustrated for two cases-for a point that lies in 
Vb(0) and for a point that lies outside Vo(0). 

First consider the point ac = 1 — 2u which has been assigned the edge {C,L} = {1 + 
6a;, 4 — 7u}. This edge has midpoint fi = 5/2 — l/2u. The color of the edge {C, L} is obtained 
in terms of the first component of the midpoint of the edge (5/2) and the difference between 
the first components of the edge endpoints (4 — 1 = 3) by determining whether |_(5/2)/3j is 
odd or even. In this case it is even, hence it is assigned the color 0. (If it had been odd, it 
would have been assigned the color 1. An expression for the coloring rule is given later in 
(p2|).) The specific orientation of this edge is then obtained by determining which endpoint 
of {C, L} is closer to ac. In this case L = 4 — 7a; is closer to ac than C = 1 + 6u. Since 
the edge has color equal to 0, the closer endpoint becomes the channel 1 label, i.e., ac is 



assigned the edge (L, C) (this is the edge direction rule (|23f ), which is explained in detail in 
Section ^2~5|) - 

Now consider the lattice point A = 18 + IOoj ^ Vo(0). The nearest lattice point is 
A' = 17+9o;. We compute the difference A — A' = (1 + u) (the point b) and use this to look up 
the corresponding undirected label in Table [I]. This gives a u (l +u) = {O, B} = {0, 6 + 5a;}. 
Using the shift property, the undirected label for A is then obtained by shifting the edge by 
A' to give a u (X) = {17 + 9lj, 23 + 14a;}. To determine the correct edge orientation, we first 
determine the color of the edge using the first component of the midpoint ((17 + 23)/2 = 20) 
and the first component of the difference ((23 — 17) = 6) to obtain a color c({17 + 9u, 23 + 
14a;}) = [20/6J (mod2) = 1. Since the color is 1, the closer endpoint becomes the channel 
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2 label. Hence 18 + 10u is assigned the label (23 + 14a;, 17 + 9a;). 

We now illustrate the decoding procedure. Assume that ~e = (23+14cj, 17+9o;) and write 
its undirected version using the basis vectors of the sublattice u and v to get {4u + 3v, 3u + 
2v}. Look for an equivalent edge in Table [I]. One such edge is {0,B} = {0, u+v}. Determine 
the shift required to make the edges coincide. In this case {4u + 3v} — A' = {u + v, 0}, with 
A' = 3u + 2v. Upon looking up Table [l|, we find that lattice point b with representation 
1 + oj has the undirected edge {O, B} as label. We shift this point by adding A' = 3u + 2v 
to get one of the candidate points A = 3u + 2v + (l+Li;) = 18 + 1 0u. The other candidate 
point is obtained from the Property 3 of the labeling function (the sum of the endpoints of 
an edge is equal to the sum of the points that it labels), and is 22 + 13co>. Observe that there 
is another edge in Table [1] which is equivalent to the edge we wish to decode. We would 
obtain exactly the same set of candidate points if we used this edge. In order to determine 
the correct point, since c(e) = 1, we decode to the point which is closer to the channel 2 
label, namely 18 + 10a;. 

Several observations can be made at this point. In Table [L] there are two kinds of undi- 
rected edges (of positive length)-those which are diameters of a circle centered at and those 
which are not. The diameters are the edges {A, D}, {B, E} and {C, F}. Both orientations of 
a diameter are used to label points in Vo(0), whereas only one orientation of a non-diameter 
is used. For an edge which is not a diameter, the remaining orientation labels a lattice point 
outside Vo(0) as determined by the shift property. For example, consider the label {L,C}. 
The directed label (L,C) is the label for the point ac = 1 — 2u e Vo(0). The lattice point 
which is labeled by (C, L) is given by 2/i — (1 — 2u) = 5 — oj — (1 — 2oj) = 4 + u, which 
belongs to the discrete Voronoi set of the sublattice point A. 

Notice that the labeling function shown in Table [1] exhibits an additional symmetry that 
we have so far not used. If a point is rotated by a multiple of ir/3 radians about the origin, 
its corresponding undirected label is also rotated by the same amount about the origin. 
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Consider T = {7^ = expi/c7r/3, k — 0, 1, . . . , 5}, a rotation group of order 6. By considering 
equivalence classes relative to this group, we can reduce the size of the table by listing only 
the undirected edges for the points {o, a, g, n, t, s}. 

The above example illustrates the basic steps that are to be followed in order to label 
the points in A. Additional details and some underlying theory is presented next. 

5.2 General Principles 

The construction of our labeling function involves the following steps. 

1. Selection of a geometrically similar sublattice of given index N. 

2. Construction of Vo(0), the discrete Voronoi set around 0. 

3. Establishing a mapping between elements of Vo(0) and undirected edges in such a way 
that certain constraints are satisfied. The optimal construction requires that a specific 
linear programming problem be solved. 

4. Extension of the mapping to the entire lattice. 

5. Identification of a specific directed edge to associate with a lattice point, once the 
undirected edge is known. 

In the remainder of this section, we will further describe items 3, 4 and 5. But first we state 
the following guiding principle. 

5.2.1 A Guiding Principle 

Suppose that A receives the label e = (A' 1; A' 2 ) as illustrated in Fig. [7|. Then d s {~e) satisfies 
the identity 

2d s (~e) = ||A - A'J 2 + ||A - A' 2 || 2 = (1/2) || A' x - A 2 || 2 + 2r 2 , (21) 
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Figure 7: A lattice point A and its label (A' 1; A' 2 ). A is at distance r from the midpoint of the 
labels. 

where r 2 = ||A — (X[ + A 2 )/2|| 2 . This identity is known as the parallelogram law (see for 
example 0, page 3). From this we infer that in order to keep d s (~e*) small, A' x and A 2 should 
be as close together as possible, and A should be as close as possible to their midpoint. This 
leads to the following: 

Guiding Principle: Choose the shortest possible edge with midpoint as close as 
possible to the point to be labeled. 



5.2.2 Optimal Construction of £ u (0) and a u (Items 3 and 4) 




Figure 8: The set Sd\ ai =o for N = 31. 
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Figure 9: Illustrating the optimal edge selection within a given equivalence class. Shown 
is an edge e, another edge in its equivalence class [e] and the optimal edge in this class for 
labeling the point A. The points on the hexagonal grid are sublattice points. 

The starting point for determining the set of edges is to compute £d\ ai =o, which is chosen 
to be the set of N shortest undirected sublattice edges of the form (0, A'). This set is 
illustrated in Fig. ||. The corresponding set £ u \ ai =o is obtained by replacing each directed 
edge with its undirected version. Observe that edges of positive length in £ u \ ai= o occur 
in equivalent pairs. Next, for every A G Vo(0) and e G £ u \ ai =o, determine d s (X, [e]) = 
ming e [ e ] d s (X,e) and let a* (A, [e]) be an edge e G [e] which achieves this minimum. In other 
words, a*(A, [e]) is the "closest" edge to A which lies in the same equivalence class as e. 
Clearly, from the guiding principle, the "closest" edge will be the one whose midpoint is 
closest to A. The edge a* (A, [e]) for a given A and e is illustrated in Fig. ||. 
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Consider all one-to-one maps (3 : Vo(0) — > £ u \ ai =o which satisfy the constraint that 
equivalent points are mapped to equivalent edges. From among all such maps j3, choose (3* 
so as to minimize ^AeVb(o) d s {\ [/5(A)]). The map (3* sends a lattice point to an edge coset 
element in S u \ ai= o in an optimal way, thus identifying the best edge coset for a given lattice 
point. Let a u (X) = a*(X, [j3*(\)]). Since (3* identifies the optimal edge coset for each lattice 
point and a* identifies the best coset representative, given the lattice point and the coset, we 
obtain the optimal edge for each lattice point by composing these two mappings. It follows 
that S u (0) = {a u (X) : A G Vo(0)}. We extend the mapping to the lattice A using the rule 
a u (\ + A') = a u (\) + A'. 

The constraint imposed on the mapping (3 needs some explanation. It arises from the 
third assumption that we made about the labeling function, namely, that the sum of the 
end points of an edge is equal to the sum of the two points that it labels. By requiring that 
equivalent points map to equivalent edges, it can be shown that the midpoint of two lattice 
points that share the same (undirected) label coincides with the midpoint of the label itself. 



A graphical justification for this is provided in Fig. [10]. More formally, the argument is as 
follows. The points in Vo(0) occur in equivalent pairs. If two points in Vo(0) are equivalent, 
they sum to 0. Consider the pair A a and — A a and an edge e. If the edge in [e] which is closest 
to A a , say e a , has midpoint a, then the edge in [e] which is closest to — A a will have midpoint 
—a. Thus S u (0) contains the edges e a and — e a (which may be identical). Now from the shift 
property, e a also lies in £ u (2a) = £ u (0) + 2a (note that 2a is a sublattice point) and the point 
it labels, say A&, is given by A& = — A a + 2a. Thus the two points that are labeled using the 
undirected edge e a , namely A a and A;,, satisfy X a + X b = 2a, i.e., the midpoint of the edge 
coincides with the midpoint of the points that receive this edge as label. To summarize, the 
constraint is a sufficient condition to ensure that the labeling function has Property 3. 

It is to be noted that the optimal mapping (3* can be obtained using standard techniques 
from linear programming |^T[ . Also observe that if we define the group V = {!,—!}, we can 
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Figure 10: Explanation of reason for mapping equivalent points in Vb(0) to equivalent edges. 
The lattice A 2 together with a similar sublattice of index N = 13 is shown. Points A a and 
\ b in Vo(A^) are equivalent and X a + \ b = 2A' 1 . A a and \ b are mapped to equivalent edges 
e a and e b . Here e a = e b + (A' 2 — A'J. The point X b + (A' 2 — \[) lies in Vo(A' 2 ) and is labeled 
by e b + (A 2 — \[) = e a . Thus A a + (X b + (A 2 — A^)) = A^ + A' 2 . The midpoint of two points 
labeled by the same undirected edge is equal to the midpoint of the edge. 

force (3* to satisfy the constraint by considering only Vo(0)/T and £ u | ai= o/r. This problem 
is one of matching (N — l)/2 lattice points to (N — l)/2 edge classes. Further reductions in 
complexity may be obtained by using a larger group T, in which case the problem is reduced 
to matching (jV — l)/o(T) points to (N — l)/o(r) edge classes, where o(T) is the order of the 
group. In the case of the A 2 lattice, for example, we could take T to be a group of order 6. 

The mapping a u identifies the edge to be associated with A up to the orientation of the 
edge. The correct orientation is determined by an edge orientation rule, designed to maintain 
balance between the two descriptions. This is described next. 
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5.2.3 Balance 

Given an edge e and two points {A a , Xb} that it labels, there are two ways to establish a one- 
to-one correspondence between the points and the two directed edges { e , e }, as described 
in Fig. [TT]. The first selection rule favors the second description, the second favors the first 



Ai a; 




Figure 11: Given an edge e = {A'^A^} and the two lattice points {A a , A&} that it labels, 
with the midpoint of e coinciding with the midpoint (A a + A&)/2, there are two possibilities 
for the selection rule. In the figure the lattice points are joined to the sublattice points by 
both a single line, indicating the first component, and a double line, indicating the second 
component. On the left the double lines are shorter than the single lines, a selection rule 
which favors the second description, that is, d 2 is smaller than d\. On the right the single 
lines are shorter than the double lines, a rule which favors the first description. Balance is 
achieved by requiring that both rules are used equally often. 

description. Note that the distortions are anti-symmetric, i.e., d\{e) with the first selection 
rule is equal to d 2 (e) for the second, and d 2 (e) for the first rule is equal to di(e) for the 
second. Because of this anti-symmetry, balance is attainable in an average sense by ensuring 
that the two correspondences are used equally often. We achieve this by requiring that the 
two correspondences are alternated along any straight line of the edge graph, as shown in 
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Fig. [T^. This is the purpose of the edge coloring rule which is described next. 




Points Points 

Figure 12: An illustration of the alternating structure along a straight line for maintaining 
balance between the two descriptions. A single line connecting a lattice point to a sublattice 
point indicates the channel 1 label for that lattice point, a double line indicates the channel 
2 label. 

5.2.4 An Edge Coloring Rule 

Each edge e is assigned a bit (or coloiQ) c(e) as follows. Consider an edge of the form 
(a + bui, c + duj). Let Ai = |c — a\ and let A 2 = \d — b\. Then 

( 0, if Ai > and |_(c + a) /{2A l )\ is even, 
c(e) = < or if Ax = and [(d + b) /(2A 2 )J is even, (22) 
y 1, otherwise. 

This coloring rule ensures that adjacent edges along any straight line have a different color. 
Note that the color does not depend on the orientation of an edge, i.e., e , and e have 
the same color. The coloring rule is an ingredient in the edge and point selection rules that 
we now define. 

5.2.5 Edge Direction Rule and Point Selection Rule 

Given an (undirected) edge e and a point A for which this edge is a label, we choose an 
orientation or direction for the edge using a rule that depends on the color of the edge. Let 
e = {A' 1; A' 2 } and let \i = (X[ + A' 2 )/2. The two rules s c (e, A), where c = or 1 is the color of 
2 During this research we used red and green to color the edges. 
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the edge, are defined as follows (x denotes the cross- or vector-product of two vectors and 
(-, •) their inner product): 

/i) > or 

fi) = and sign((A; - A' 2 ) x (A - //)) > 0, (23) 
fj) > or 

fjt) = and sign((A' 1 - A' 2 ) x (A - /i)) > 0, (24) 

Observe that the result of either rule is the same whether we write e = {A' 1; A 2 } or e = 
{A 2 ,A'J. 

For decoding, since two lattice points receive a label from a given undirected edge, we 
need to be able to tell which point is being labeled, given the edge orientation. This is the 
reverse of the edge direction rule. Thus, given a directed edge ~~e = (A' 1; A' 2 ) with midpoint /j, 
and a lattice point A which could have received this label, the Point Selection Rule g c (~^, A) 
selects A or 2/i — A based on the edge color c, and is given by 

(A; - A' 2 , A - fj) > or 

(A; - A' 2 , A - n) = and sign((A' 1 - A' 2 ) x (A - //)) > 0, (25) 
A otherwise. 

A (A; - A' 2 , A - fi) > or 

(A; - A 2 , A - fJ) = and sign((A' 1 - A 2 ) x (A - /i)) > 0, (26) 
otherwise. 

5.2.6 Constructing the map a 

Using the notation previously established, we obtain a as follows. Given A, let e = a u (X) 
and let c = c(e). Then a(A) = s c (e, A). 



(a;-a 2 ,a- 

(A2, A^), otherwise. 

and 

r (a 2 ,a;) (a;-a 2 ,a- 

ai(e,A) = I (\[ — A 2 , A - 

^ (A' 1; A 2 ) otherwise. 
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5.2.7 Proof that the Reuse Index is Correct 

We need to show that for any sublattice point A', exactly N lattice points have a label of 
the form (A', *) and exactly N lattice points have a label of the form (*, A'). 

Consider the graph drawn on the vertex set A', where the edge set is £ u = |JA'eA'(^ u l a i=°"'" 
A'). This is the entire set of undirected edges or labels, or equivalently, the range of the map 
a u . Observe that for any A' G A', there are exactly N edges in S u of the form {A',*}, or 
equivalently, there are exactly N edges incident on the vertex A'. Each edge {A', A"} of 
positive length labels two points, of which one receives the label (A', A"), the other (A", A'). 
Thus exactly N lattice points receive a label of the form (A', *) and exactly N receive a label 
of the form (*, A'). 

5.2.8 Further Reduction in Complexity: Group Construction 

Instead of imposing the constraint on the map /3 that was used in Section 4.2.2, we could 
alternatively regard this map as an unconstrained map between cosets A/A'/T and £ U /A'/F, 
where T is the group of rotations {1,-1} (in complex notation since we are talking about 
A 2 ). Now we need only establish a correspondence between two sets of size (N — l)/2, where 
2 is the order of the group. Further reductions in complexity arise from selecting a larger 
group that contains the group {1, —1} as a subgroup. For A 2 , we used the group of rotations 
{exp(ikir/6), k = 0, 1, 2, 3, 4, 5}. This reduces the complexity of matching problem to sets of 
size (N — l)/6. Precise conditions that the group must satisfy, and further reasons for using 
a group, are explained in Section 6. 

5.2.9 Numerical Results 

The results of our optimization procedure for the hexagonal lattice A 2 are displayed in 
Fig. [H^, along with comparisons with the Z lattice. These results have been obtained for 
a uniformly distributed memoryless source by computing the optimal labeling function and 
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Numerical evaluation of the MSE for the lattice h 2 
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Figure 13: A plot of di v.s. d for the hexagonal lattice A 2 and the integer lattice Z. 
then evaluating the expression (obtained from fljjD for a uniform probability density function) 



where e is the edge that labels A, do is computed using (|H]) and known values of G(A) |TT| . 
To be comparable with A2, the value of iV shown for the Z lattice is the square of the actual 
reuse index for dimension L — 1. To be more specific, let denote the index for the 
A 2 sublattice, and let N% be the index of the sublattice of Z. Then the value of N stated 
in the figure is iV| for Z and Na 2 for A2. Also it should be noted that for each N, both 
lattices have been scaled in order to keep the product Nu constant, where v is the volume 
of a fundamental region of the scaled lattice. From (|I7|), this is equivalent to keeping the 
rate constant for all points on the graph. It is seen that small performance improvements 
are obtained by using A 2 instead of Z. Another benefit is that we obtain many more points 
in a given interval of (say) the side distortion, compared with the Z lattice. 





AeVo(o) 
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6 Labeling Functions for General Lattices 

In this section we describe how to label a general lattice A using a sublattice A' of index 
[A : A'] = N. The basic steps remain the same as for A 2 . The main differences arise in the 
selection of the sublattice and in the use of a group to simplify the construction. We begin 
by establishing certain general conditions that the group should satisfy. Specific groups 
and sublattices will then be given for certain particular lattices. We will use G to denote 
a generator matrix for A and cGG for the generator matrix for the similar sublattice A', 
where c is an scalar and G is a unitary matrix. Our convention is that the columns of a 
generator matrix are a basis for the lattice. 

6.1 Sufficient Conditions for the Group, T 

The smallest group we can use is V = {1^, —II}, where II is the L-dimensional identity 
matrix. Here we show why a group is useful for reducing the size of the optimization problem 
and derive certain conditions that the group should satisfy. 

The motivation for using a group is to make use of inherent symmetries in the lattice and 
sublattice. Our objective is to partition the discrete Voronoi set and the edge set into subsets 
of equal size with certain distance properties. More specifically, for any subset of lattice 
points {Aj, z = 1,2,... , M} in this partition and any subset of edges {e^, i = 1, 2, . . . , M} 
in the partition the set of distances T>i = {d s (Xi, ej), j = 1, 2, . . . , M} should be independent 
of i. Such sets of points and edges can be obtained by identifying a group of transformations 
T = {7^, k — 1,2, ... , M} and then taking the members of the partition to be orbits under 
the action of this group. The group we look for should have following properties. 

1. T contains —II- 

2. T is an orthogonal group. 
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3. T preserves the lattice A. 



4. T acts fixed-point free on 1R L , i.e., for any 7 G T, 7 not the identity, jx = x 



x = 0. 



5. The order of the group divides the g.c.d. of all the shell sizes. 

6. T preserves the sublattice A'. 

Property 2 ensures that orbits of the group lie entirely within a shell of the lattice. Property 
3 is obvious, otherwise orbits would contain points other than lattice points. Property 4 
ensures that all orbits are of equal size. Property 5 ensures that each shell is partitioned into 
an integral number of orbits. Property 6 is similar to Property 3. 

We now look at Properties 3 and 6 more closely. Every lattice point A can be written 
in terms of the generator matrix G and an integer vector u as A = Gm. By requiring that 
7jGm = G^jU for some 7^ G T, we ensure that the lattice is preserved. Similarly, if the 
sublattice has generator matrix cGG, where c is a scalar, then by requiring 7jG = Gjj, 
for some jj G T, the sublattice will also be preserved. In other words we require that V 
normalizes G and G. 

6.2 Group Construction and Generator Matrices 

For the space lattice Z 2 , we take N to be an odd number of the form a 2 + b 2 where a, b G Z. 
(It is shown in that similar sublattices of Z 2 exist whenever N is a sum of two squares.) 
The generator matrices are G = I2 and G' = GG, where 




(28) 



For the group we use 




(29) 
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a group of order 4. 

For the lattice Z 4 we take N to be an odd perfect square (again see 



Let N 



b 2 + c 2 + d 2 , a,b,c,d G Z (any integer can be written this way). The generator matrices 



are L and G' = GG, with 



G 





a —b 


—c —d \ 
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—d c 
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The group Y is 



±U,± 



a group of order 8. 

For Z 8 , it is easiest to start by specifying the group. Let 

/ 1 

10 

1 

-10 



7i 



10 

10 

1 

-1 / 



and 



7s 



1 











-1 






-1 





-1 
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1 
10 
10 



(30) 



(31) 



(32) 



(33) 
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Then we take the group to be T = {7^, 7s7i, i — 0, 1, 2, . . . , 7}, a group of order 16. The 
generators for the lattices are G = and G' = GG, where the ith column of G is , 
where v=(a0b0c0d 0)* r , a 2 + b 2 + c 2 + d 2 = N, the index of A', and % = 0, 1, . . . , 7. 




3 3.5 4 

Reuse Index (per dimension) 



Figure 14: A plot of d s v.s. the reuse index (per dimension) N l l L for the lattices Z* 



% = 1,2,4,8. 



Numerical computations for the lattices A = Z* (standardized to have minimal length 



1) for i = 1,2,4,8, are presented in Fig. |1J. These results have also been obtained for a 
uniformly distributed memoryless source. Since the two-channel distortions are identical for 
all the lattices considered in this figure, we have only plotted the excess distortion term 
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(1/-/V) X^AeVb(o) ^s(A) against the per-dimension reuse index N l ^ L . 

7 Asymptotic Analysis 

We now derive upper and lower bounds on the distortion d s as given by (|15*|). As we have 
already seen in (|27j), the regularity of the labeling function and the high rate assumption 
lead to the following simplification for the the expression in (p^|): 

d s = d +— ^( e )> ( 34 ) 

AGVb(O) 

where e is the label for the lattice point A. Thus in order to analyze d s we only need 
to consider edges that label points in the discrete Voronoi set Vo(0). Our analysis relies 
on a precise knowledge of the lengths of these edges. Suppose that A is labeled by the 
edge e = (A'^A^), as in Fig. [7]. Let /(e) denote the length of the edge e = {A'^A^}, i.e., 
/(e) = || A^ — A' 2 ||, and let r be the distance of the point A from the midpoint (A^ + A' 2 )/2. 
Then 

24(e) = ||A - A'J 2 + ||A - A 2 f = (l/2)/(e) 2 + 2r 2 . (35) 

A simple lower bound for d s (e) is obtained by setting r to zero in the above equation. In 
order to obtain an upper bound, observe that the midpoint of a sublattice edge can always 
be made to lie in Vo(0) by a suitable sublattice shift. An upper bound is then obtained (using 
the triangle inequality) by replacing r with r*(A') = 2i?(A'), where -R(A') is the covering 
radius of the sublattice. Thus we have 

(l/4)/ 2 (e) < d s (e) < (l/4)/ 2 (e) + r*(A') 2 , (36) 

which by using ( |34"D leads to the bounds 

+ E l 2 (e)<d s <d + ^ ^)+r*(A') 2 - (37) 

Aevb(o) Aevb(o) 
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7.1 Asymptotic Performance 

In order to carry out a rate-distortion analysis, it is necessary to scale A and A' by a real 
number (3. We will use v((3A) to denote the volume of a fundamental region for the scaled 
lattice (3 A. Clearly v((3A) = (3 L v(A). For convenience we will write v for v(A). Upon 
rewriting ([H]) for the scaled lattice, we obtain 



Ro 



h(p)-(l/L) log 2 (v(/3A)) 
h(p)-(l/L) hg 2 ((3 L u). 



(38) 



Similarly, an expression for R is obtained by rewriting ( |T7D in order to get 



R 



h(p)-(l/L) log 2 (iV^A)) 
h(p)-(l/L) \og 2 (Np L u). 



(39) 



From ([l0|) , the two-channel distortion with the scaled lattice (3 A is given by 



d = G{A)u 2/L (3 2 , 



(40) 



where we have used the fact that G(A) = G((3A). 

In terms of Rq, the two-channel distortion <i is thus given by 



d = G(A)2 2h(p) 2" 2iJo 



(41) 



Now let N = 2 L ( aR+1 \ Then R = R{1 + a) + 1 and 



= G(A)2»0) ^ 



(42) 



For given A r and i?, the correct scale factor is obtained by solving ([40]) for /3: 



/5 L 



2ift(p)2- i -R( 1 + a ) 



(43) 



2 L u 
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Consider d defined by 

d=^ E ( 44 ) 

Aevb(o) 

which is the common term in the bounds for d s given in fl37|). The quantity (3 2 arises because 
we use the scaled lattices /3A and /3A'. It is understood that e is the edge that labels A. The 
edges in question in ( f4"4|) (the edges in £d(0)) have been obtained by choosing the N shortest 
edges in f3A', with one endpoint at and then shifting these edges so that the midpoint is as 
close to the origin as possible. Thus each / 2 (e) is of the form iN 2 / L /L for some i 6 Z. The 
term N 2 ^ L is a scale factor that comes from the fact that [A : A'] — N and we normalize by 
L because we are working with normalized square lengths. Let the largest value of l 2 {e) in 
(0) be equal to KN 2/L /L and let B { be the number of / 2 (e)'s that are equal to iN 2/L /L. 
Then 

~ 1 XpHBJf^ 

rf= 4iV^— L— (45) 

i=0 

Our construction of the set £^(0) implies that the Bi can be obtained in terms of the coef- 
ficients of the theta series of the lattice A. To be specific, if Oa(z) = Yli A-iZ 1 is the theta 
series}] for the lattice A, then we can assert that 

Bi = A h < i < K , 

B K < A K . (46) 

This fact will be used a little later. 

Now substitute 3 from (Q) &nd use the fact that 2~ 2aR = A/N 2 ^ L , in order to obtain 

2 2/l (p)2 _2i? ( 1_a ) K 

d = V 2/L N (l+2/L) 1 E lBi 
K 

= S^zA, (47) 

i=0 



J Aj is the number of lattice points A with £||A| 
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where we have defined S = 2 2h ^2~ 2R ^ /(u 2 / L N^ 1+2 ^L). The term *£f=o iB i can be 
bounded in terms of the A^s by 

K-l K K 

j2 iA i^J2 iBi ^J2 iAi - ( 48 ) 

i=0 i=0 i=0 

Upon defining S(m) = X^=o Ai anc ^ us i n S Abel's summation formula we obtain 

m m— 1 

iA = mS{m) - s ( n )- ( 49 ) 

i=0 n=0 

The term S(n) is the number of lattice points in the first n shells of the lattice A. This is 
roughly the ratio of the volume of S^n 1 / 2 ), a sphere of radius n 1 / 2 , to v, the volume of the 
Voronoi cell of A. To be specific, if Bl denotes the volume of a sphere of unit radius in R L 
then lim^oo S(n)/n L / 2 = B L jv. Thus S(n) is given by 

B T n L / 2 

S (n) = ^_(l + o(l)), (50) 



where lim n ^ooo(l) = 0. Upon using (|50|) in order to estimate S(m), we obtain 



- A | fnB L m L/2 ^2 B L n L/2 

i=0 \ n=0 



V 

to— 1 



^( m V2+l_^ n L/2j (1 + o(1)) 



n=0 



R / ™(L/2+l) \ 

^ f(™ ,1/2+1, -(?72TT) +0 ( ml/2+1 )) (1 + 0(1)) 

= ^i_^ m (V2+i)( 1 + ( 1 )) ( 51) 
i/ L + 2 v v v j 

On substituting (0) into (f47|) and observing from fl50|) that AT = (B L K L/2 /r/)(l + o(l)) we 



obtain 



J= — 2 2 ^2- 2fl ( 1 " a )(l + o(l)). (52) 

i# L (L + 2) 
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But 



7T L / 2 



Bl = W2 + T)> (53) 

and G(Sl), the normalized second moment of a sphere in L dimensions is given by 

G(S L ) = ^-l^-T(L/2 + lf L . (54) 
Thus -Bl is given in terms of G{S£) by 

B ^ = G(S L ){L + 2)> (55) 

and from (|52|) it follows that 

d = G{S L )2 2h{p) 2~ 2R{l ~ a \l +o(l)). (56) 

The other terms in fl37f ) are Jo and r*(A') 2 . The term rf decays as 2~ 2 - R ( 1+a ) and r*(A) 2 decays 
like (3 2 N 2/L , which in turn decays as 2~ 2R . Thus lim^oo 42 2R(1_a) = lim ii _ >00 d2 2R ^~ a) and 
we have obtained our final result: 

lim d s 2 2R ^ = G(S L )2 2h( - p \ (57) 

R— >oo 

We end with a comparison with the multiple description rate distortion bound (f|), by 
letting L — > oo in fl42]) and fl57l). It is believed that as L — > oo, G(A) — > l/27re and it is 
easily shown from ( |54"D that lim^oo G(Sl) = l/2ire. Thus our constructions are optimal. 

8 Summary and Conclusions 

The problem of lattice vector quantizer design is addressed for the two-channel multiple 
description. The main problem in the design, a labeling problem, is solved. A systematic 
construction technique is developed which is suitable for general lattices. Specific construc- 
tions have been provided for A 2 and Z l , i = 1, 2, 4, 8. Finally an asymptotic analysis reveals 
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that performance arbitrarily close to the multiple description rate distortion bound can be 
obtained. 

Open issues related to this work are detailed constructions for other lattices, extensions 
to the asymmetric case and extensions to greater than two descriptions. 
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